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Summary 


This  report  describes  virtual  reality  technology,  which  uses  three-dimensional  user- 
generated content,  and  its  use  by  the  U.S.  military  and  intelligence  community  for 
training  and  other  purposes.  Both  the  military  and  private  sector  use  this  new 
technology,  but  terrorist  groups  may  also  be  using  it  to  train  more  realistically  for  future 
attacks,  while  still  avoiding  detection  on  the  Internet.  The  issues  for  Congress  to 
consider  may  include  the  cost-benefit  implications  of  this  technology,  whether  sufficient 
resources  are  available  for  the  communications  infrastructure  needed  to  support 
expanded  use  of  virtual  reality  technology,  and  whether  there  might  be  national  security 
considerations  if  the  United  States  falls  behind  other  nations  in  developing  or  adopting 
this  new  technology.  This  report  will  be  updated  as  events  warrant. 


Virtual  Reality  and  Web  2.0 

Virtual  Reality  (VR)  technology  enables  Web  content  that  is  interactive  and  user- 
generated. However,  VR  technology  goes  beyond  traditional  Web  pages,  and  allows  users 
to  operate  in  three-dimensions  of  space,  simulated  within  the  computer.  VR  is  part  of 
what  is  known  as  Web  2.0,  a second-generation  method  of  using  Web  technology  to 
create  communities,  or  social  networks,  where  instead  of  passively  viewing  content,  each 
user  can  dynamically  create  and  modify  and  share  Web  content.  Thus  Web  2.0 
technology  allows  users  to  collaborate  and  create  self-organizing  communities  that  can 
(1)  increase  the  value  and  power  of  peer  relationships  and  (2)  simultaneously  disrupt 
traditional  real-world  methods  for  hierarchical  control  over  information  flows.1 

Early  examples  of  2-D  Web  2.0  social  network  communities  include  YouTube, 
Linkedln,  and  Wikipedia.  Similar  Web  2.0  tools  were  developed  and  used  by  junior 
military  officers  during  Operation  Iraqi  Freedom  to  create  notes  about  observed  enemy 
movements  and  then  quickly  share  this  information  among  multiple  unit  commanders. 


1 Don  Tapscott  and  Anthony  Williams,  Wikinomics,  Penguin  Group,  New  York,  2006. 
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Initially,  senior  military  officials  became  concerned  about  security  and  their  loss  of 
control  over  classified  information  flows.2  However,  unit  commanders  convinced  DOD 
leadership  of  the  value  of  peer-controlled  sharing  information  about  insurgents’  adaptive 
movements,  which  resulted  in  an  officially  sanctioned  system  now  called  Cavnet,  which 
allows  fast  access  to  knowledge  acquired  on  the  ground  in  combat.3  Other  social 
networking  sites  now  sanctioned  by  the  military  include  “Companycommand”  and 
“Platoonleader,”  both  accessible  via  password.4 

Many  businesses  now  use  different  2-D  Web  2.0  tools  to  accelerate  innovation,  and 
several  large  corporations  have  also  established  simulated  presences  inside  commercial 
3-D  VR  worlds  to  expand  real-world  sales.  Several  government  agencies,  including  the 
Centers  for  Disease  Control  and  Prevention,  the  National  Oceanic  and  Atmospheric 
Administration,  and  at  least  one  member  of  Congress  have  experimented  with  setting  up 
their  own  presences  in  VR  environments.5 

Simulation  and  Military  Training 

Modeling  and  computer  simulation  have  traditionally  been  used  to  train  military 
pilots  and  tank  crews.  In  many  cases,  the  trainee  steps  into  a simulator  device,  which  is 
surrounded  by  screens  that  generate  a 3-D  image  completely  controlled  by  high-powered, 
computerized  artificial  intelligence.  However,  new  VR  tools  go  beyond  many  traditional 
limitations  and  now  allow  multiple  participants  to  freely  interact  with  each  other  in  the 
similar  3-D  computerized  environment.  In  many  cases,  computer  networking  capabilities 
have  dramatically  increased  to  the  point  where  users  can  now  run  complex  3-D  VR 
simulations  in  the  field  using  a laptop  connected  to  the  Internet.6  Training  with  VR 
allows  large  numbers  of  personnel  to  interact  in  a simulated  face-to-face  environment 
with  other  distant  military  units  through  the  Internet  (or  through  the  classified  network 
known  as  SIPRNET),  and  with  first-responder  units,  civilians,  and  even  medical 
personnel  units,  providing  a training  experience  that  is  increasingly  effective,  but  at  a 
much  lower  cost  than  would  be  required  for  assembling  these  personnel  for  a real-life 
face-to-face  training  exercise. 

VR  technology  offers  a potentially  effective  and  economically  efficient  tool  for 
training  military  personnel  to  better  deal  with  dynamic  or  potentially  dangerous  situations. 
VR  participants  use  self-designed  computer  images  called  avatars  that  look  and  act  like 
real  people,  and  operate  in  virtual  world  environments  that  can  have  almost  any 


2 PBS  Frontline,  Innovating  and  Improvising,  [http://www.pbs.org/wgbh/pages/frontline/shows/ 
company/lessons/] . 

3 PBS  Frontline,  Innovating  and  Improvising,  [http://www.pbs.org/wgbh/pages/frontline/shows/ 
company/lessons/].  William  Matthews,  Helping  Info  Flow  Freely  Insurgents  Outdo  U.S. 
Military,  Says  U.S.  3-Star,  Defense  News,  January  28,  2008,  [http://integrator.hanscom.af.mil/ 
2008/January/0 1 3 1 2008/0 1 3 1 2008-14.htm] . Wikipedia,  [http://en.wikipedia.org/wiki/CAVNET] . 

4 Dan  Baum,  Annals  of  War:  Battle  Lessons,  The  New  Yorker,  January  17,  2005. 

5 Trudy  Walsh,  Get  a life:  Congress,  NOAA  test  the  water  in  a virtual  world,  GCN.com,  February 
19,  2007,  [http://www.gcn.com/print/26_04/43147-l.html]. 

6 Kathleen  Hickey,  Virtual  training  gets  real.  Government  Computer  News,  November  19, 2007, 

p.  16. 
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combination  of  simulated  characteristics  — a busy  checkpoint  in  downtown  Baghdad,  or 
a subway  tunnel  in  downtown  New  York  under  chemical  attack  by  terrorists.  The 
resulting  interactions  can  be  unpredictable  and  can  seem  highly  realistic  to  the  individual 
operators  involved.  Some  of  the  avatars  can  simulate  local  citizens  and,  when  operated 
by  real-life  actors,  can  demonstrate  culturally  correct  gestures,  show  facial  expressions, 
and  communicate  emotions,  which  military  personnel  trainees  must  interpret  correctly 
during  these  virtual  world  encounters.7  For  a more  detailed  discussion  of  the  effects  of 
virtual  reality  on  trainees  and  operators,  see  “Your  Guide  to  Virtual  Worlds,”  at 
[http://www.pbs.org/mediashift/2007/10/digging_deeperyour_guide_to_vi.html],  a 
website  that  is  affiliated  with  the  PBS  media  enterprise. 

Intelligence  Operations 

The  intelligence  community  has  started  exploring  for  how  VR  communities  might 
become  actual  battlefields  in  the  future,  complete  with  cyber  weapons  for  launching 
attacks  against  terrorists  or  other  enemies.  Intelligence  officials  point  out  vulnerabilities, 
because  vendors  for  many  commercial  VR  communities  do  not  keep  records  of 
conversations  between  avatars,  or  monitor  how  VR  areas  are  used,  some  of  which  can  be 
protected  by  strong  passwords.  However,  other  officials  also  think  this  level  of  concern 
is  unwarranted,  and  that  fears  of  threats  to  national  security  in  VR  are  overblown.  They 
also  indicate  that,  even  though  some  users  may  engage  in  clandestine  activity,  some  VR 
products  employ  electronic  tools  that  automatically  look  for  risky  behavior  by  avatars.8 

The  intelligence  community  has  also  indicated  that  it  may  initiate  a study  of  the 
behavioral  characteristics  found  in  virtual  worlds,  to  identify  emerging  social,  behavioral, 
and  cultural  norms.  The  lessons  learned  would  be  used  to  help  automatically  detect 
suspicious  behavior  and  actions  of  individuals  operating  in  virtual  worlds  that  might  pose 
a threat  to  national  security.9 

Communications  Infrastructure 

Some  experts  expect  that  virtual  reality  and  virtual  worlds  will  have  the  same  impact 
on  business  and  government  entities  as  has  the  Internet  itself.  However,  U.S. 
communications  infrastructure  and  acquisitions  methods  are  relatively  old,  and  many 
Asian  countries  are  well-networked  with  advanced  equipment  that  may  offer  advantages 
that  could  allow  them  to  establish  the  global  standards  for  VR  technology.10  China,  for 
example,  has  begun  construction  of  a virtual  world  called  HiPiHi,  reportedly  with 


7 Michael  Peck,  Soldiers  Learn  Hazards  of  War  in  Virtual  Reality,  National  Defense,  February 
2005,  [http://www.nationaldefensemagazine.org/issues/2005/Feb/UF-Soldiers_Learn.htm]. 

8 Robert  O’Harrow,  Spies'  Battleground  Turns  Virtual,  Washington  Post,  February  6,  2008,  p. 
Dl. 

9 Office  of  the  Director  of  National  Intelligence,  description  of  Project  Reynard,  Data  Mining 
Report,  February  15,  2008,  p.  5. 

10  Press  release,  Gartner  Says  80  Percent  of  Active  Internet  Users  Will  Have  A “Second  Life  ” in 
the  Virtual  World  by  the  End  of  2011,  April  24,  2007,  [http://www.gartner.com/it/page.jsp?id= 
503861], 
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infrastructure  that  will  support  up  to  75  million  simultaneous  users.11  Some  observers 
note  that  any  country  that  succeeds  in  dominating  the  VR  market  may  also  set  the 
technical  standards  for  the  rest  of  the  world,  and  may  also  own  and  operate  the  VR  servers 
that  give  them  unique  access  to  information  about  future  global  financial  transactions, 
transportation,  shipping,  and  business  communications  that  may  rely  on  virtual  worlds. 

Some  U.S.  military  and  state  government  communications  systems  rely  on 
commercial  products  and  leased  communications  lines  for  training  for  homeland  defense 
operations.12  However,  a research  survey  in  2007  found  that  “American  companies  are 
not  poised  to  be  the  leaders  in  embracing  Web  2.0  technology  in  coming  years.  If 
anything,  they’re  looking  like  laggards.  Leading  the  way  are  Indian  firms,  80%  of  which 
plan  to  increase  their  investments  in  Web  2.0  over  the  next  three  years,  compared  with 
69%  of  Asia-Pacific  firms,  65%  of  European  firms,  64%  of  Chinese  firms,  64%  of  North 
American  firms,  and  62%  of  Latin  American  firms.”13  These  observers  question  whether 
the  United  States  could  adequately  protect  the  security  of  its  assets  if  future  VR 
communications  standards  and  servers  were  controlled  by  another  country,  or  possibly  an 
adversary  country.14 

DOD  Programs 

The  military  is  reportedly  planning  to  build  a virtual  world  called  “Sentient 
Worldwide  Simulation,”  which  will  “mirror”  real  life  and  automatically  follow  real-world 
events  in  real  time.  Some  virtual  world  scenarios  are  also  used  to  train  medical  personnel 
for  mass  casualty  events.  To  do  this,  VR  hospital  rooms  are  designed  to  duplicate  actual 
civilian  or  military  facilities,  and  are  populated  with  individually  controlled  avatars  for 
nurses  and  physicians,  which  interact  with  avatars  of  National  Guard  members  and  first 
responders  who  must  also  locate  and  transport  avatars  of  patients  with  different  injuries. 
Other  uses  include  therapy  treatment  for  military  veterans  suffering  from  Post-Traumatic 
Stress  Disorder  (PTSD).  The  treatment  objective  is  to  help  veterans  deal  with  troubling 
experiences  in  Iraq  or  Afghanistan  by  immersing  them  back  into  the  sights  and  sounds  of 
simulated  past  battles.  To  provide  a treatment,  the  therapist  can  manipulate  effects  the 
patient  sees  in  a simulation  to  best  suit  the  needs  of  the  patient.  The  repeated  treatments 
are  intended  to  gradually  reduce  the  experiences  that  trigger  the  trauma,  and  the  memory 


11  Personal  conversation  with  U.S.  State  Department  officials,  2008. 

12  Personal  conversations  with  National  Guard  officials,  2007.  For  example,  “Guardnet”  runs 
over  a Wide  Area  Network  (WAN)  that  is  leased  from  a commercial  carrier.  It  supports  data, 
voice,  and  video  for  National  Guard  homeland  defense  and  remote  combat  readiness  training,  as 
part  of  the  Distributive  Training  Technology  Project.  Geoff  Fine,  National  Guard  Units  Train 
Without  Leaving  Home,  National  Defense,  February  2003,  [http://www.nationaldefense 
magazine.org/issues/2003/Nov/National_Guard.htm] . 

13  Two  views  of  Web  2.0  in  business,  [http://www.roughtype.com/archives/2007/03/american_ 
compan.php].  How  businesses  are  using  Web  2.0:  A McKinsey  Global  Survey, 
[ http://www.mckinscyquartcrly.com/articlc_abstract_visitor.aspx7ai- 1 9 1 3&12=1 3&I3=  1 1& 
srid=9&gp=l]. 

14  Ramsey  Shaffer,  Baxter  Technology  Group,  personal  communication,  January  30,  2008. 
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of  the  event  may  become  tolerable.  Early  results  from  trials  reportedly  suggest  that  virtual 
reality  therapy  is  well-suited  to  a generation  raised  on  video  games.15 

“Urban  Resolve”  was  a distributed  training  simulation  carried  out  in  2006  by  U.S. 
Joint  Forces  Command  (JFCOM),  Joint  Experimentation  Directorate,  simultaneously  at 
the  U.S . Army  Topographic  Engineering  Center  at  Fort  Belvoir,  Virginia,  and  at  the  Space 
and  Naval  Warfare  Systems  Command  facilities  in  San  Diego,  California.  The  training 
exercise  used  virtual  world  technology  to  help  develop  skills  in  urban  warfighting 
operations  for  future  joint  force  commanders.  The  scenario,  which  involved  more  than 
2 million  individually  simulated  objects  interacting  in  Baghdad  in  the  year  2015,  pitted 
a U.S. -led  coalition  force  against  an  adversary  operating  in  an  urban  environment. 

JFCOM  is  also  planning  to  run  a series  of  experiments  in  another  virtual  reality 
training  exercise,  called  “Noble  Resolve,”  which  involves  homeland  security  scenarios 
that  protect  against  a possible  nuclear  attack  by  terrorists.  In  one  simulation,  a nuclear 
bomb  will  explode,  and  the  virtual  world  will  enable  evaluation  of  collaboration  among 
local,  state,  national,  and  international  officials.  Government  officials  are  seen  as 
directing  first-responder  and  law-enforcement  operations  alongside  military  personnel  in 
a realistic  VR  environment.  According  to  the  trade  press,  JFCOM  officials  have  also 
indicated  that  they  plan  to  build  intricate  VR  simulations  of  many  cities,  with  the  final 
goal  of  creating  a fully  functioning  virtual  model  of  the  entire  world,  which  will  be  known 
as  the  Sentient  Worldwide  Simulation.  This  reportedly  will  become  a “synthetic  mirror” 
of  the  real  life  that  will  automatically  follow  real-world  events  in  real  time.16 

The  Training  and  Doctrine  Command  (TRADOC)  Project  Office  for  Gaming  (TPO 
Gaming)  is  a new  Army  organization  intended  to  integrate  video  game  graphics  into 
training  simulations  for  soldiers  and  small-unit  leaders.  The  new  office  plans  to  develop 
an  Army  simulation  tool  kit,  scheduled  for  deployment  between  2010  and  2015,  that 
allows  end  users  to  build  and  customized  their  own  training  scenarios  without  needing  a 
contractor  to  do  it  for  them.17 

Operational  and  Cost  Areas 

VR  is  not  always  the  best  choice  for  military  training.  For  example,  VR  simulators 
are  usually  located  in  comfortable  environments,  with  air  conditioning  to  cool  computer 
equipment,  so  the  operators  never  get  tired  from  running  with  a large  backpack,  or  wet 
and  cold,  or  otherwise  physically  stressed  as  they  would  in  a real-world  training  exercise. 
However,  VR  offers  the  following  advantages:  (1)  the  training  mission  can  be  repeated 
numerous  times;  (2)  worst-case  and  emergency  scenarios  can  be  simulated  without  the 
risk  of  injury  to  trainees;  and  (3)  real  military  equipment  is  not  used  in  VR,  so  costs  for 
equipment  maintenance  and  fuel  are  eliminated.  VR  is  increasingly  seen  as  a useful  way 


15  Virtual  Iraq  — VR  Based  Therapy  for  Post-Traumatic  Stress  Disorder,  Defense  Update,  2005, 
Issue  3,  [http://www.defense-update.eom/produets/v/VR-PTSD.htm]. 

16  Josh  Rogin,  JFCOM  brings  virtual  world  closer  to  home,  FCW.com,  April  4,  2007, 
[http://www.fcw.com/online/news/98 147-1  .html?type=pf], 

17  Michael  Peck,  Constructive  Progress,  Defense  News,  December  3,  2007,  p.  32. 
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to  supplement  or  reduce  the  number  of  real-world  exercises  needed  to  adequately  train 
military  personnel. 

Policy  Issues 

Some  experts  expect  that  global  commerce  will  come  to  rely  heavily  on  VR.  In  a 
world  where  banking,  transportation  control,  communications,  and  other  global  commerce 
are  arguably  conducted  in  VR,  they  question  how  the  United  States  will  defend  its 
national  assets  if  global  VR  standards  are  dominated  by  China,  or  if  a majority  of  VR 
servers  are  physically  located  in  and  operated  by  China. 

Right  now,  the  U.S . military  does  training  in  VR.  Some  ask  whether  a day  will  come 
when  the  U.S.  military  might  also  conduct  actual  war  fighting  operations  in  VR  to  defend 
U.S.  assets  and  national  security.  Should  research  be  funded  to  develop  exploits  specific 
to  VR  that  can  be  used  by  DOD? 

How  does  the  U.S.  communications  infrastructure  to  support  VR  compare  with  that 
of  China,  or  with  other  countries? 

To  what  extent  could  VR  help  the  intelligence  community  track  possible  terrorist 
activity? 

How  do  the  costs  and  benefits  of  VR  compare  to  the  cost  and  benefits  for  traditional 
military  training  exercises?  Have  there  been  evaluations  of  VR  effectiveness?  What  are 
the  implications  of  the  expansion  of  this  technology  to  other  military  activities? 


